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A sublinear variance bound for solutions of a random 
Hamilton-Jacobi equation 

Ivan Matic* and James Nolen^ 



£^ ■ Abstract 

We estimate the variance of the value function for a random optimal control problem. The 
value function is the solution w e of a Hamilton-Jacobi equation with random Hamiltonian H(p, x, uj) 
K(p) — V(x/e,uj) in dimension d > 2. It is known that homogenization occurs as e — > 0, but 
little is known about the statistical fluctuations of u> e . Our main result shows that the variance 
of the solution w t is bounded by 0(e/\ log e|). The proof relies on a modified Poincare inequality 
of Talagrand. 
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1 Introduction 

In this paper we study the random optimal control problem 

u(t,x,u) = sup g(~/(t)) - £(7,£j), x£R d , t>0 (1.1) 

■ in dimension d > 2, where the supremum is taken over the set of admissible paths 

CN " : , 

VO ■ A* = {7 G W l >°°([0,t];R d ) | 7 (0) = z}. 

o 

CN ' The upper-semicontinuous payoff function g : R d — >■ R U {— oo} is given. The cost functional £ has 

the form ^ 

£(7,w)= / L(V( a ),7W,w)ds= / ^( 7 '( S )) + y(7(s)^)^, 
K> | Jo j o 

where K(p) : R d — > [0, oo) is convex and grows super dinearly in \p\. The function V(x,oj) is a 
scalar random field that is statistically stationary and ergodic with respect to certain translations 
in x. The parameter uj £ Q denotes a sample from a given probability space (Q,J-,¥). Thus, the 
value function u(t,x,uj) is random. Our main result shows that the variance of u(x,t,uj) grows only 
sublinear ly in t as t — > oo. 

Under certain conditions on g and L, u(t, x, uj) is uniformly continuous and is a viscosity solution 
[3] of the random Hamilton-Jacobi equation 

f ut = H(Du,x,u), xeR d , t>0 
\ u(0,x) = g(x), x£R d , 
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where H(p,x) = K*{p) — V(x), K* being the Legendre transform of K. For simplicity, consider 
the case where g(x) = rj ■ x is a linear function. Then for each e > 0, the function w e (t,x,uj) = 
eu(t/e,x/e,oo) solves the initial value problem 

( wt = H(Dw e ,*,u), xGR d , t>0 
I u> £ (0, x) = rj ■ x = g(x). 

For certain Hamiltonians H (p, x, oo) which are convex in p, statistically stationary and ergodic with 
respect to translation in x, it is known I13j that as e — > 0, homogenization occurs (see also [2, 9j 
for alternative proofs and [61 [U Q2] for related results). This means that the functions w e (t,x,oo) 
converge locally uniformly in [0, oo) x R d , as e — > to the deterministic function w(t, x) which solves 

f w t = H(Dw), x G R d , t > 
) w(0, x) = g{x). 

The function H (p) : R d — > M is called the effective Hamiltonian. We may think of this convergence 
as kind of law of large numbers for w e , although the limit w and the effective Hamiltonian H are 
not determined by a simple averaging. Beyond this convergence result, relatively little is known 
about the properties of H , about the rate of convergence w e — > w, or about the statistical behavior 
of w e — E[u> e ], where E[-] denotes expectation with respect to the probability measure P. Our work 
pertains to this last issue: in terms of w e (t,x,oo), our estimate on the variance of u implies that 
v&r(w e (t, x, uj)) < Ce/| loge|, as e — > 0. 

Before stating our main result, let us make some definitions and assumptions more precise. We 
will suppose the random field V(x,lo) has the following special structure. Let a < b be two real 
numbers. Let ft = {a, b} zd be the set of all functions u : Z, d — > {a, b}. Let the probability measure 
P be the shift-invariant product measure on ft determined by P(u>fc = a) = a and P(u^ = b) = /3, for 
all k G where a G (0, 1) and (3 = 1 — a. Thus the random variables {oJk\k&z d are independent 
and identically distributed. Now for k G Z d , let Qj~ = k + [0, l) d denote the unit cube with corner 
at the point k. Given oj G ft, define V(x,oj) : M. d x fl — > {a, b} by 

V{x,u) = J2u> k I Qk (x), (1.5) 

with lQ k is the indicator function for the set Qk- Thus, x i— > V is piecewise constant, taking values 
a or b on the unit cubes. By construction, the law of V(x,lj) is the same as that of V{x + k,u)) 
for any k G This precise construction of the field V(x,u) is not essential for our result to hold. 
In particular, the function could be mollified so that it is uniformly continuous, or V(x,u>) could 
depend on the values of w/t for A: in a bounded neighborhood of x. Nevertheless, the choice of P as 
the product measure on Q = {a, 6} z is motivated by the main analytical tool presented below in 
Theorem 11.21 

We suppose that K : W 1 — > [0, oo) is convex, K(0) = 0, and that 

,. K(z) 

hm — : — — = +oo. 

\z\— >oo \z\ 

For the case of dimension d = 2 we will make use of an extra non-degeneracy condition: for some 
v > I, 

K(z)>\z\ u Vz€B 1/2 (0). (1.6) 

Given V and K, let L(p, x, u) = K(x) + V(x, oj) and let u be defined by (jl.ip . The following estimate 
of the variance of u for large t is our main result: 
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Theorem 1.1 Let d > 2. Let x G M. d and suppose that g : M. d — > EU {—00} satisfies 

g(y) <g(x) + C 1 (l + \y-x\), Vy G M d (1.7) 
There is a constant C > 0, depending only on C\, K , a, f3, and \b — a\, such that 

vax(u(t,x,u)) <Cj^, Vt>2. (1.8) 

The main tool that we use to control the variance of u(t, x, u), is the following theorem, which is 
a slight variation of an inequality of Talagrand (see [2], Theorem 1.5). This result holds for product 
spaces of the form f2j = {a, b} J , J being a finite set, and P being the product measure on Qj with 
marginals P(wj = a) = a G (0, 1) and ¥(ojj = b) = /3 = 1 — a, for all j G J. Let us define (ftjU to be 
the element of {a, b} J which is identical to ui except that the j-th component ui j is opposite to ujj. 
That is, (pjio = a/, where uj' k = uJk for k 7^ j, and uj'- 7^ ujj. For each random variable / : fij — > R 
define o-jf(uj) = f((pjUj) and 

Theorem 1.2 There is a constant C > 0, independent of \J\, such that 

ZioWs /or a// / G L 2 (Oj). 

The idea of using this inequality to estimate the variance of f(w) = u(t, x, to) comes from the work 
of Benjamini, Kalai, and Schramm [4J who used this inequality to estimate the distance variance in 
first passage percolation, a problem which has some features similar to the control problem (II. ip . 
Specifically, they consider the length of minimal paths between two points in the integer lattice 
7j d under a random metric. Each edge e in the nearest-neighbor graph is assigned an independent 
random weight u e G {a, 6}, and the length of a path between two points x,y G Z d is defined as 
the sum of the edge weights along a path connecting x and y. They proved that var(<i w (0, v)) < 
C\v\/ \og\v\, where <i w (0,-u) is the length of the shortest path connecting and v. See [5] for some 
extensions of that result. The main difficulty in applying the ideas of [1] to the present setting comes 
from the different structure of the cost functional £(7,0;), which necessitates more control on the 
optimizing paths. 

As we have mentioned, for d > 2 there are relatively few results about the random fluctuation 
of u(t,x,co) (as t — > 00) or w e (t,x,co) (as e — > 0). In [ID], Rezakhanlou derived conditions under 
which a central limit theorem holds for w e (t,x) where w e is the solution of the Hamilton- Jacobi 
equation (jl.3p . i.e. whether e~ 1 l 2 {w e — w) converges in law to some nontrivial stochastic process 
as e — > 0. In the case d = 1 those conditions can be verified for Hamiltonians having the form 
H(p,x,uj) = K{p) — V(x,lo), and the limit distribution can be computed (see Corollary 2.6 in [10J ) . 
For d > 2, however, it is difficult to verify those conditions. Indeed, our result shows that we may 
have var(u> e ) = o(e), which is less than what a CLT as in [10] would suggest. As this paper was being 
written, we learned of another work by Armstrong, Cardaliaguet, and Souganidis |T|, who study the 
rate of convergence w € — >■ w. Our Theorem 11.11 pertains to the variance of w e , i.e the statistical error 
w e — E[w e ], but does not give an estimate of the bias K[w e ] — w. 

The paper is organized as follows. In Section [2] we derive some properties of the paths 7 which 
nearly optimize (jl.ip . Section [3] contains the main argument for the proof of Theorem II .11 Section 
H] and Section [5] contain proofs so some technical estimates needed in Section EU 
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2 Properties of optimizing paths 

Without loss of generality, let us suppose x = and simply write u(t,u) = u(t,Q,u)) and 

At = A t ,o = {7 G W^iMiR*) I 7 (0) = 0}. 
So, we are studying the quantity 

u(t,u) = sup 5 ( 7 (t)) - £( 7 ,w). (2.10) 

yeAt 

for some function g : R d -> R U {-00}, with g(Q) G R. For 5 > and w e f2, let Ms(t,oj) be the set 
of all paths j £ At such that 

g(-f(t)) - C( 7 ,uj) >u(t,u)-5. 

For each 5 > 0, this set is non-empty, and we refer to these paths as 5-approximate optimizers. 
Observe that Mg 2 (t,oj) C Mg 1 (t,oj) if < 62 < 6\. If an optimal path 7 exists, meaning that 
u(t,co) = g("f(t)) — £( 7 ,w), then it is certainly an approximate optimizer for any 5 > 0. In this 
section we derive some useful properties of approximate optimizers which will be used in the proof 
of Theorem 11.11 

Deterministic Bounds 

First, we have a few estimates which do not involve the random structure of the control problem. 
Lemma 2.1 Let 7 E Mg(t, uS). Then for any ri,r 2 £ [0, t], 

f 2 L(V( 4 ),7( a ), U ) ds < (r 2 - n )b + (r 2 - n)K flM^jM] + S , (2.11) 
Jn V r 2 -n ) 

and 

[ T2 L( 7 / ( g ),7( S ),^) ds > (r 2 - n)a + (r 2 - n)g f 7(r2) ~ 7(ri) ) . (2.12) 

y n V r2-ri y 

Proof of Lemma I2.lt Given 7 6 M$(t, oj), define a new path 7 6 i( according to 

7( s ) = 7( r i) + (s - n) s6 n,r 2 

r 2 - rx 

and 7(5) = 7(s) for s ^ [^1,^2]- Thus we have replaced a section of 7 with a straight-line path 
connecting the same points. Since 7 G .M^w), we must have £(7,0;) < £(7,0;) + (5. In particular, 

/ L( 7 ', 7 ,w)ds < / L(7 ; ,7,w)ds + (5 

/ 7(^2) -7(n) ' 



< (r 2 -n)6+(r 2 -ri)^ ^ . (2.13) 

V r 2 - n / 

This proves (|2.1ip . The lower bound (|2.12|) follows from Jensen's inequality, the convexity of K, 

and the fact that V(x,U)) > a. □ 
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Lemma 2.2 Suppose that jil^lU {-oo}, 3(0) E K, and 

g(y)<g(0) + C 1 (l + \y\), V y E M d . (2.14) 
There is a constant R depending only on K , C\, and b — a such that 

h(t 2 ) - 7(*l)| < + 1*1 -t 2 \), V t 2 , h E [0, t] 
/2,0/ds for all paths 7 E Mx(t, oS) and all t > 1. 

Proof of Lemma 12. 2t We first show there is a constant Rq depending only on K, C±, and b — a 
such that 

\l(t) - 7(0)| <tRo (2.15) 
holds for all 7 E Mi(i,u;) and all t > 1. Define the path 7(5) = 7(0) = for all s E [0,t]. We have 

> 5(0) - C(ff,u) > y(0) - tb. (2.16) 

By (|2.12p . we also have the lower bound 

Since 7 E M\(t, cj), we may combine these two estimates with u(t,u) < 1 + 5(7^)) — £(7,0;) to 
conclude 



A" 



2W - ) < 1 + („ - a) + - £g> < 1 + (i, - a) + g, fl+llWI ) . 

t J t t V t J 



Since i^(f>) grows super-linearly in |p|, (I2.15P follows. 

Next, consider 7 at integer times k E [1, t — 1] fl Z. We will show that there is a constant Ri, 
independent of t > 1, such that at least one time k E [1, £ — 1] D Z must satisfy both 

|7(fc)-7(fc-l)| < Ri and | 7 (A: + 1) - j(k)\ < R x . (2.17) 

Arguing by way of contradiction, let us suppose (|2.17p does not hold. Then + 1) — > Ri 
must hold for at least t/3 of the times j E [1, t — 1] Pi Z. This implies that 

u(t, u)<l + 5 ( 7 (t)) - £(7, w) < 1 + g{j(t)) -at -I mm K(q). 

6 \q\>Ri 

On the other hand, by Lemma 12.11 and (|2.15p . we know that 

u(t, u) > g(j(t)) -bt- tK{ 7 ^ ~ 7 (°) ) _ 1 > g(j(t)) -bt-t max K(q) - 1 

t \q\<Ro 

holds for all 7 E Mx(i, w). Combining these two bounds we obtain 

- min K(q) < 1 + (b — a) + max K(q). 

3 |g|>Ki |g|<Ro 

If R\ > Rq is sufficiently large (depending only on b — a, Rq, and K) this forces a contradiction. So, 
(|2T7) must hold. 
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Now we conclude the proof. Let R 2 > Ri, and suppose that for some t%,t 2 E [0, t] with 1 < 
\t 2 -h\ < 2 we have |-y(t 2 ) - 7 (ii)| > R 2 . Let k G [l,t - 1] n Z be such that (|2TT|) holds. Without 
loss of generality, we may suppose k + 1 < t\ < t 2 . Consider the path 7 defined by 



7(a) = 
and for s S [ii — l,t 2 ] 



7(s), for s£ [0,fc-l]U[* 2) t], 

7(fc - 1) + (s - k + l)(7(fc + 1) - j(k - 1)), for sejfc- 1, k], 
j(s + 1), for s e [k,ti - 1], 



7( s ) = 7 ( tl ) + ( 7 (* 2 ) - 7 ( tl ))i_^±l. 

12 — CI + 1 



Then we have 

£(7) -£(7) < 4(6 - a) + / IT^s)) ds + / 2 ir(7'(s))ds 

./jfc-1 Jti-i 

iT(7'(s))ds- / if(y(a))ds 
< 4(6 - a) + K(j(k + 1) - 7 (fc - 1)) + (t 2 -h + 1)K(^ 1 ' 2 ' ~ ' ( ' ' ' 



to-U+l 



2 / V <2-*i 

< m + (t 2 - tl + i)* (f^^r) - - ( ^I^ ) , (2-18) 

where 

M = 4(6-a)+ max K(z). 

\z\<2R ± 

Let At = t 2 -h and cr = (At + l)/(At) and z = ( 7 (t 2 ) - 7(ii))/(i 2 -*i + 1). The inequality ([248]) 
has the form 

£(7) - £(7) < M + (At + l)K(z) - AtK(az). (2.19) 
The properties of K (convexity and super-linear growth) imply that if R 2 sufficiently large, then 

inf K(az) - aK(z) > M + 1. 
|*|>fla/3 

Applying this at f|2. 19|) we conclude £(7') — £(7) < 1, which contradicts the fact that 7 G Mi(t, w). 
Therefore, we must have \j(t 2 ) — 7(ti)| < i?2 if 1 < \t\ — t 2 \ < 2. This and the triangle inequality 
now imply the desired result for all ti,t 2 £ [0, t]. □ 



Important cubes 

Our method of estimating the variance of u involves bounding the random variable \ajU — u\. So, 
we must understand when changing the value of Uj leads to a large change in the value of u(t,u>). 
Given a path 76^ and an index j £ define 

n j ( 7 ) = \{sE[0,t}\j(s)eQ j }\, 

which is the total time that the path 7 occupies the cube Qj. Observe that for any path 7 £ .At, we 
have 

£(7,^) < C(i,u) + (6-^)^(7). (2.20) 
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In particular, if 7 € Mg(t,U)), then 

aju(t, uj) = u(t, 4>jUj) > 5(7(*)) - At, 4>j^) 

> 5(7(*)) - ^(7iw) - (6- w j )vr i (7) 

> u(t,w) - (6-^)^(7) -<5. (2.21) 

From this we deduce that if ujj = b or if there is 7 G Mg(t,uj) for which 7^(7) = 0, then it must be 
true that u(t,uj) — aju(t,uj) < 6. On the other hand, this also shows that if u(t,u) — aju(t,uj) > 5, 
then ujj = a and 7^(7) > must hold for all 7 G Mg(t,uj). This motivates the following definition. 
We say that the cube Qj is important if ujj = a and for some 5 > we have 

7^(7) >0, \/ 7 e M 5 {t,u)). (2.22) 

Observe that if (|2.22p holds for some 5 > 0, then it also holds for all 8' £ (0,5]. So, Qj is important 
if Uj = a and for 5 sufficiently small every (5-approximate optimizer spends time in cube Qj. Let 
Xj C £l denote the event that the cube Qj is important: 

Xj = {wefi ujj = a; 35 > such that 7^(7) > V 7 G M<$(i, w)} (2.23) 
= (J {u G O I wj = a; 7^(7) > V 7 G M 1/n (t, w)} . (2.24) 

n>l 

The above analysis shows that 

{wGO u(t,w) > o-j-ii^.w)} C Xj, V j G Z d (2.25) 

so we have 

P(cr i u < it) < P(X,-). (2.26) 

Observe that depends on t, in addition to j. 

It will be useful to further classify some cubes as very important. To this end, we define a set of 
cubes 

N(5,u)= [j {k G Z d I 7r fe ( 7 ) > 0}. 

■y€M s {uj) 

This is the set of all cubes visited by some path 7 G M$(t, co). Next, we define the event Xj C Xj C Q 
that cube Qj is very important: 

Xf = {u g Xj I 3 <5 > such that w/ = 6 V £ G JV(5, w) \ {j}}. (2.27) 

On this event, Qj is an important cube, and for any other cube Qi visited by a path 7 G Mg, we 
have oj£ = b, if 5 is sufficiently small. On the event XJ = Xj \ Xj~ , cube Qj is important but not very 
important: for any 5 > we can find a path 7 G M,j(a;) such that 7 passes through another cube 
Qi Qji 011 which uj£ = a. The following lemma shows that the only way for (u — Oju) 2 lzj to be 
large is if Qj is very important. 

Lemma 2.3 There is a constant Cq > 0, depending only on K and \b — a\, such that 

P ({uj I (u - (Jjuf\ x - < C }) = 1 

holds for all t > 1 and j G Z d . 
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Proof of Lemma 12.3b If ojj = b, then oj ^ X- , so obviously (u — aju) 2 \ x - = 0. Hence, we may 

assume ojj = a and oj G XJ . When ojj = a, we clearly have OjU < u, since £( 7 , <j)jOj) > £(7,0;) in 
this case. So, we must bound u — OjU from above. 

Consider an approximate optimizer 7 G Mg(oj) for some 5 < 1. If 7Tj( 7 ) < C then it — cijU < 
(6 — a)C + 5 according to (|2,2ip . So, we must consider the possibility that 7Tj( 7 ) > is large. Since 
oj G XJ , we may assume the path 7 also passes through another cube Qg, with I ^ j, for which 
uj£ = a. We will construct a new path 7 such that 7^(7) < 1 and C(^,oj) < £(7,0;) + C. The two 
paths 7 and 7 will have the same starting and ending points. This implies that the difference u — OjU 
is bounded by a constant, since by (|2,20p we have 

(Xju = u(t, foul) > g{j(t)) - C{*f,<t>jUj) 

> gtf(t)) -£(j,oj) -(6-0)^(7) 

> 9{ A f{.t))-C(j,o))-C-(b-a)iT j (j) >u(t,uj) - C - (b- a) - 5. (2.28) 

Suppose that [£1 , ^2] is the smallest interval containing all s for which 7(5) G Qj. We may assume 
t2 — ti> 7^(7) > 1. Suppose that 7(^3) G where t 7^ j and = a. We may suppose that £3 > £2 
(the case £3 < ii is similar). Define the new path 7 as follows: 

(i) For s G [0,ti], let 7 (s) = 7 (a). 

(ii) For s G [t ls t! + 1], let 7 (s) = 7 (ti) + (s - ti)( 7 (* 2 ) - 7 (*i)). 

(iii) For s G [h + 1, ti + 1 + (t 3 - £2)], let 7 (s) = 7 (s - t x -l + t 2 ). 

(iv) For s G [ti + 1 + (i 3 - t 2 ),t 3 ], let 7 (s) = 7 (i 3 ). 

(v) For s G [t 3 ,t],let 7 (s) = 7 (s). 

Much of 7 is just a linear reparameterization of 7, and we have 

[* L(rf(s),nr(s), U )ds - f L(j'(s), 1 (s),o>)ds < K(j'(s))ds < K( rf (t 2 )-'y(t 1 )). 

Jo Jo Jti 

Since (7^2) — t(*i)| is bounded by the diameter of cube Qj, we have £( 7 ', oj) < £( 7 ,u>) + C. □ 

3 Proof of Theorem 11.11 

In this section we prove Theorem 11.11 As we have mentioned, the main argument is similar to that 
of [1]. In particular, it is convenient to average u(t,oj) over a random shift of the environment. 

Random shifting of the environment 

We now consider an augmented probability space = Q x Oi with product measure P = P x Pi, 
and we introduce a random function h{oj\) : Qi — > Z d to define a random shift of the environment. 
For {oj,oj\) G $7, let us define 

u(t, oj, oji) = u(t, Th^oj) = sup 5(7(0) - £( 7 + h(oJi),oj) (3.29) 

where 7 + h{ui\) denotes the shifted path t t-> j(t) + h{oj\). We define Mg(oj,oJi) = Ms^tuujAOj) to 
be the set of paths 7 G At for which 

u(t, uj, ojt) < 5(7(0) - £( 7 + h(oJi),oj) + 5. 
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We construct fix, Pi, and h in such a way that \u(t,ui,ui\) — u(t,ui)\ = o(y/i), and for this reason an 
estimate of var(w) that is sublinear in t will imply a sublinear bound for var(u). 

The random shift h(uj\) will lie in the set [0, m) d C M rf where m = \ t^\ , for some positive £ < 1/2. 

For d > 3, it will suffice to choose £ G (t, |)- For d = 2, we will require that C E (C=r, 1/2) , where 
f was defined by the non-degeneracy condition (II, 6p . Denote by Po the product probability measure 
on the set Qo = {a, b} m and having marginal distribution Pg(a) = a, Pq(o) = (3 = 1 — a G (0, 1). 
The following statement is Lemma 3 from [3], so we omit the proof: 

Lemma 3.1 There exists a constant C > independent of m = and a function h : S7o — > 

{0, 1, . . . , m — 1} for which the following two conditions hold: 

(i) P (h = i) < £ for all i G [0,m — 1], and 

(zzj /or every x,y G Slo i/w^ differ in at most one coordinate, the difference between h{x) and h(y) 
satisfies 

\h(x)-h(y)\<l. 

Define the set = 0j = {1,2,... , d} x {1,2,... , m 2 }. Let ill = {a, 6}®, and let Pi be a uniform 
probability measure on Oi. Each wi G Oi can be written as wi = , . . . , wf), where each u\ is a 

binary sequence of length m 2 . Let e*j denote the i-th coordinate vector. Define h{oj\) = J2i=i h(u\)ei. 
There exists a constant C > independent on m such that for each x G {0, 1, . . . , m — l} d one has 
P\(h = x) < -~[. Moreover, if uj\ and ui[ differ in exactly one coordinate then we have \h(u>i) — 
h{oj'i)\ < 1. Given the space SI = Q x Oi with the product measure P = P x Pi on x J7i defined 
in this way, we now consider the function u defined by (13.29| ). 



Lemma 3.2 There is a constant C > such that 

\u(t,u)-u(t,uj,uj 1 )\<C\h(ui)\<Ct <: , Vt>l (3.30) 
holds F-almost surely, and 

varn < Cvavu + Ct 2t: , VOL (3.31) 

Proof of Lemma I3.2t We will prove that \u(t,u) — u(t,u),u)i)\ < C\h(ui)\, P-almost surely, for 
some constant C > independent of m and t. Given a path 7 G Mg(ou), we can modify it to construct 
an approximate optimizer for u{t,u,ui), thus estimating u(t, u), oji) — u(t,u)) from above. However, 
we cannot simply shift 7 by — h(ui), since we must preserve the starting and ending points. 

Suppose |/i(wi)| < y/dn, with n G [l,m] n Z. Fixing a path 7 G Ms(oj), we define the new path 
7 in the following way: 

(i) For r G [0, «], set 7 (r) = 7 (0) + (^) ( 7 (2«) - hfa) - 7(0)). 

(ii) For r G [«, £ — «], set j(r) = j(r + k) — h(uj\). 

(iii) For r G [£ — «;,£], set 7 (r) = 7 (£) + (r - £)^^. 
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We now verify that the path 7 yields the desired bound on u(t, oj,uji) — u(t,u) and var-u. Since 
7 G M$(u), we have 



u(t,(jj,uji) - u(t,u) > — L(' x f'(s), A f(s) + h(oJi),u) ds — L(<y'(s), j(s) + h(u)i), ui) 

Jo Jt-K 



ds 



2k 



+ / L( 1 '(s),j(s),uj)ds-5 







> -Ck 1 + sup K{z) - 5, 

\ \z\<2R J 

where C is a positive real number that depends only on K, \b — a\. In a similar way we prove that 
u(t, u, oj\) — u(t,uj) < Ck + 6. Recalling that m = [i^J , we obtain (|3.30p . Therefore 

varn = E[(u - t(u)) 2 ] 



E 



u - E(u) + {u-u) - E(u - u) 



< 3 var u + 3E 



(u — u) — E(u — u) 



< 3var£t+ 12C 2 m 2 , 



which is (finffl) . 



□ 



Variance estimate for u 

Given Lemma 13.21 and the choice of £ < 1/2, we now wish to establish a bound of order t/\ogt for 
the variance of tt(t,o;,a;i) under P. The augmented probability space was constructed in such a way 
that u(t,u:,uji) is amenable to Talagrand's inequality. The function u depends on uj for only 0(t ) 
of the indices j G Z d : 

Lemma 3.3 There is a constant R > such that 

u(t,uj,uJi) = u(t,<j)jUj,uji), V j G Z rf , \j\ > Rt, t>0 

holds P almost surely. 

Proof: Since |/i(o;i)| < my/d, this is a consequence of Lemma l2.2t no approximate optimizer passes 
through cube j, if R is sufficiently large and \j\ > Rt. □ 

In view of Lemma [3. 3 1 we may regard u as a function of no more than Ct d +dm? random variables 
taking values in the set {a, b}. In this way, Talagrand's inequality (Theorem II. 2\i implies that there 
is a constant C > 0, independent of t > 0, such that 



var(n) <CV "^f 2 .,, + C V .„ ■ (3.32) 



10 



where Bt is the set Bt = {j G Z d \ \j\ < Rt}, whose cardinality is bounded by Ct d . The norms || • H2 
and || • ||i refer to the L 2 (&,P) and L 1 (Q, P) norms, respectively. Observe that if k G @t, then p^f 
corresponds to translation of the random environment: 

(TkU — U u(t, U, (t>kUJl) — u(t, UJ, UJ\) 

W = —2— = 2 • 

If j G Bt, then pju corresponds to a local change in the random environment over the cube Qf 

UjU — u u(t,(bjUJ,uJi) — u(t,oj,uJi) 
« u= — 2~ = 2 • 

Let us first consider the second sum in (|3.32p . We will show that this sum is 0(t 2 ^). 
Lemma 3.4 There is a constant C > such that 

Y < ct 2 ^ (3.33) 

^ 1 + l np . Pfc" h - 

holds for all t > 1. 

Proof: Since there are only |6t| = m 2 < t 2< ^ terms in the sum and since 

1 + log j. — ~r > 1, 

\\PkU\\l 

the lemma will follow from a uniform bound on ||pfcu||2- By definition of h(uji), we know that 
\h(4>k^i) — h(tdi)\ < 1. So. by Lemma l33| we have|u(t. to. cji ) — u(t. oj. d>Mi)\ < C\h{4>k^i) — h(u\)\ < 
C holds P almost surely, for all k G 0^, t > 1. □ 

Having established f|3.33j) . we now consider the first sum in (|3.32p . 
Proposition 3.5 There is a constant C > such that 

y Ilft"jl2 < c_L (3.34) 

ZioWs /or all t > 1. 

Since we may have a / we will make use of the following fact, proved in the appendix: 
Lemma 3.6 Let C = min|^, ^ j and C" = max|^, ^ j. For any measureable set A C 0, 

C'P(A) < P(0ji4) < C"P(A) (3.35) 
Zio/ds /or all j G ^4/so ; /or every nonnegative integrable tp, we have 

C'E(iP o < E(V>) < C"E(^ o cpj). (3.36) 
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Proof of Proposition I3T51 Let us begin by estimating ll/OjuHf- By Lemma 13.61 we have 



\pju\\l = E [((TjU - u) 2 l aj u>u] +E [(a 



-,u — u] 2 



la 3 u<u\ < CE [((TjU - u) 2 l ajil<i 



Recalling the definition (|2.23p . let Xj C fi be the event that Qj is an important cube in the shifted 
environment: 

Xj = {(qj,uji) G | T h{u)l) uj G Xj}. 
Because of (|2.25p . the event \(TjU < u} is contained in the event Xj. So, we have 

\\pju\\ 2 2 <Ct (ajU-ufl t . . (3.37) 

The difference \o~jU — u\ could be large in some cases, even on the event Xj, so we will distinguish 
a few possible scenarios. Let X^ C Xj denote the event that cube Qj is very important in the shifted 
environment: 

2"+ = {(ui,uix) G Xj | T h(LUl) u G 2"+}. 
Similarly, let 2„~ = X 7 - \XJ~ be the event that the cube Qj is important but not very important. Since 

J J 3 J 

u i y T/j( wl )W is measure preserving on Q, we have 

¥({(u,ui) e£l\(u- o-ju) 2 l ± - > C }) = g n | (u- (Jju) 2 \ x - > C }). 



Consequently, from Lemma 12.31 and (|3.37p we have 



\pju\l 2 . < CE 
< CE 



{(TjU — u) 2 lj-+ 



+ CE 



{(TjU — U) 2 lj-- 



o-jU-uyi t + +CC F(Ij 



(3.38) 



Whether the event Xj has small probability depends on the function g(y), so we distinguish two 
cases. Let Gc!J denote the even that 

\l(t) - 7(0)| >t l '\ V 7 G Mi(w,wi). 

On this event, all approximate minimizers must travel a distance at least 0{t 1 ^) from their starting 
point 7(0) = 0. According to the following lemma, the probability that minimizers travel that far 
when a cube Qj is very important must be small. 



Lemma 3.7 There are constants ki,K2 > such that 



\XJ n G) < Kie" 



Vi>0, j G 7L a . 



Therefore, returning to ()3.38|) and using the fact that \o~jU — u\ < 0(t) and Xj = (Xj D G) L) 
(Xj n G ), we conclude 

\\pju\\l < Ct 2 e- R2tl/A + Cf(Xj) + CE \(ajU - u) 2 l t+r 



L i+nGC 



Hence, 





< C\B t \t 2 e~ K2t + CE 


Eh 


+ CE 


E 


jeBt 











L 2+n<5c 



(3.39) 



With probability one, the sum Y2jeB t ^ s bounded by 0(t) because there can be at most 0(t) 
important cubes, as the total number of cubes visited is 0(t), by Lemma 12.21 
The last term in (13.39P is bounded as follows. First, 
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Lemma 3.8 There are k±,K2 > such that 

P({(w,a;i) | (ajU-uflgo > C t 1/2 }) < ^e'" 2 ^ 4 
holds for all t > 1 and all j £ Z d . 

Furthermore, if w G X^~, then cj ^ X^ for any k ^ j, since must be the only important cube. 
Therefore, since \(JjU — u\ < \b — a\t always holds (by (|2.2ip ). we must have 



E 



^2{a j u-u) 2 l i+ 



KCotW + lb-al^e-***'*. 



Considering (|3.39|) . we have now shown that there is a constant C > for which 

jeBt 



(3.40) 



holds for all t > 1. 

Next we consider the denominator in (|3.34p . We show that there is a constant C" > such that 



log 



\PjU\\ 2 



> C'loei, 



\Pj u \\i 

for all t > 1. By the Cauchy-Schwarz inequality we see that 

\\PjU\\l = \\PjU • l aj u^u\\l < \\Pju\\2 ■ J*P((TjU ^ U). 

Since o-jCTjU = u, Lemma [3T61 implies 

F(a jU + u)= F(o-jU >u)+ F(o-jU < u) < (1 + C")¥(ajU < u). 

Hence, 



(3.41) 



\PjU\\2 
|Pj"l|l 



> 



1 + C")P(ffj« < «) 



(3.42) 



Therefore, to bound logdlpjtil^/ll/OjwIli) from below, we should find an upper bound for F(ajU < u). 
Because of (I2.26p . we know that 

P(ajU < u) < P(Xj). 
To estimate P(Xj) we average in ui, as was done in [3]: 



P(Xj) = E 



[E[ 



E E U I w 



E 



ze[0,m-l] d 



1~ I u>, /i(^i) = z P\{h(u)i) = z) 



(3.43) 



Observe that (w,u;i) G Tj if and only if there is 5 > such that 

7^(7) > for all 7 € M s (u,Ui), 
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which holds if and only if for some 5 > 
So, for Xj- defined by (|2.24j) . we have 



E 



If | u},h(u)i) = z = 1x, z (t z u). 



(3.44) 



By Lemma |3.1| we also know that Pi(h(u}\) = z) < Cm d for any z£ [0, m — l] d . Therefore, 



P(X i ) < Cm- d E 



Cm~ d E 



^E[l Xj | cj,h{cj 1 ) = z] 

z 



The last equality follows from the stationarity of P with respect to r 2 . Now, given weJ], the sum 

zg[0,m~l] d 

counts the number of important cubes within the box j — [0, m — l] d . These cubes are visited by all 
paths 7 G M^cj) for some 5 > sufficiently small. Hence, P(Zj) < Cm _cf E[#Aj] where 

A i = U { fc G Zd I i - ^ e [0,m- vr fc ( 7 ) > V 7 G Af 1/ft (w)} . 

n>l 

We may interpret the random variable as the number of important cubes in the box j— [0, m— 

Obviously we have the trivial bound #Aj < O(i). This is because each path 7 G M^cj) has 
length 0(t), by Lemma 12.21 so 7Tfc(7) > for at most 0(t) indices k. Therefore, 

E[#Aj] < t < (m+ 1) 1/C . 

If d > 3, we may choose £ G (l/<i, 1/2), so that 

Pfoti < u) < ${Tj) < Cm- d E[#Aj] < Cra^ +1/( < Ct 1 "^ 

with 1 — d£ < 0. If d = 2, we need the following: 

Lemma 3.9 Let d = 2 and assume the non- degeneracy condition hl.0\l holds. Then for each p G 
^ U ~^J~^ , 2^ there exists a constant C > suc/i f/iaf #Aj < Cm p ZioWs wt/l probability one, for all 
j G Z d . 

So, for d = 2 we still have Pfau < u) < Cm- d E[#Aj] < Cn^" 2 )^, with (p - 2)/C < 0. 
Therefore, returning to (|3.42p we conclude that there is a constant C > such that 



(3.45) 



holds for all t sufficiently large. Therefore, the proof of Proposition 13.51 is reduced to a proof of 
Lemma 13.71 Lemma 13.81 and, in case d = 2, Lemma 13.91 These are proved in the next section. □ 



Theorem 11.11 now follows immediately from (|3.32|) . Lemma 13.41 and Proposition 13.51 
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4 Proofs of the technical estimates 



Proof of Lemma 13.71 

Observe that 

P(J+ n G) = P(X+ n G) 

where G C f2 is the event for which 

|7(*) " 7(0)| > t x l\ V 7 G Mi(t,o;). (4.46) 

We will show that on the event n G, any approximate optimizer 7 G M^cj) must touch a set of 

O^ 1 / 4 ) cubes which are almost uniformly spaced on a straight line segment of length 0(t) and on 
each of those cubes we have V(x,uj) = b. Such an event can occur only with small probability. 

Suppose weltfl G, and let 7 G M 5 (cj) be such that (|4.46[) holds. Let [ii,t 2 ] C [0,t] be the 
smallest interval containing all s for which 7(5) 6 Qj. Hence, 01(7(5)) = b for all s ^ ^2]? since 
a; G X^. Since w 6 G, we know that |-y(t) - 7(0) | > t 1/4 , which means that either 

t l/4 t l/4 

lT(*i) - 7(0)| > — or | 7 (t)_ 7 (t 2 )|>__ 

must hold, because 7(ii),7(i2) G Qj- Let us assume that | 7 (i) — 7^2) | > (i 1 ^ 4 )/3 holds; the other 
case is treated in a similar manner. 

First, since w( 7 (s)) = 6 for all s G (i 2) *]) we may assume that 7 is a straight line between 7^2) 
and j(t). Specifically, by redefining 7 slightly, we may assume that 

l(s)=7(t 2 ) + 7it) ~J it2 \ s-t 2 ), VsSfat], 

t — 12 

for otherwise, 7 would not be an optimal path. This follows from (|2.12p . 

Next, given points 7^2) and j(t), there is a unique pair xt 2 ,%t £ ^ d such that 

l(t 2 ) = x t2 +y t2 , l(t)=x t + y t 

for some yt 2 ,yt G [0, l) d . Therefore, if we define the linear path 

l{s)=x t2 + — — 7^(s-t 2 ), se[t 2 ,t] 
t — t 2 

we have | 7 (s) — 7 (s)| < 2\fd for s G [t 2 ,t]. Therefore, for each s G [t 2 ,t] there must be a cube Qi such 
that dist (7(5), Q^) < 2\/d and uj{Qi) = b. For y G R rf , let B y denote the event that there is at least 
one cube Q such that dist (Q, y) < 2yfd and uj(Q) = b. Then F(B y ) = 1 - P(-B^) < 1 - a Cz < 1, for 
a constant C3 > that depends only on the dimension d. Moreover, if \y — z\ > 5y/d, then B y and 
B z are independent events. Therefore, for fixed times t 2 < t and a fixed pair of points xt 2 ,xt G Z, d 
satisfying \xp 2 — x t \ > t 1 / 4 /2 we have 



K s£{t 2 ,t] 



for some constant C4 > independent of e. 



15 



By Lemma 12.21 we know there is a constant R > such that l'j(s) — 7(0) | < tR for all s G [0,i\. 
There are at most 0(t 2d ) possible pairs xt 2 ,xt G Z d satisfying \xt 2 — 7(0) | < .Ri and |xt — -7(0) | < -Ri 
and |xt 2 — xt\ > i 1 ^ 4 . Therefore, we conclude that 

P (z+ nG)< 0(t 2d )(l - a C3 f 4tl/ \ (4.47) 

The last inequality immediately implies the lemma. □ 



Proof of Lemma 13.81 

Because ui h-> t^^oj is measure preserving on Q, we have 

P I (o-j-fi - u) 2 l dc > C t 1/2 }) = P ({u I fou - u) 2 l G c > C i 1/2 }) 

where the event G C is defined by (|4.46p . So, on the event G we know there is 7 G Mg(u) such 
that 

| 7 (t)- 7(0)| <i 1/4 - (4.48) 

Let B r {x) denote the ball of radius r > centered at x. We may assume that there are at least two 
indices j, k G Z d n 5 t i/ 4 (0) such that cjj = a and ook = «• This is because the event that = a for 
at most one of the cubes contained in £? t i/4(0) has probability less than 0((3 Nt ) where Nt > Ct 1 / 4 
is the number of cubes contained in £^1/4(0). 

Let 7 G M s (u) with - 7 (0)| < t 1 / 4 . Then 

u(t,uj) < g(j(t)) - at + 5. 

Suppose Uk = a for some k ^ j and k G B t i/i(0). Let G Qk, so that y(xfc,w) = a. Define the 
path 7 by 



7(s) 



7( 0) + s £^2), se [o >t i/4] 

x k , sG^t-t 1 ^] (4.49) 



Then 

a jU (t,uj) > g(ff(t)) - £(j,cj) > g(j(t)) - a(t - 2t 1/4 - 62i 1/4 - 2t l/i maxK(z). 

\z\<l 

Therefore, 

u(t,uj) - aju(t,uj) < (a-b)2t 1/4 + 2t 1/4 max K(z). 
Hence (u — aju) 2 < Cot 1 / 2 except possibly on a set of probability less than 0(f3 Nt ). 



□ 



Proof of Lemma 13.91 for d — 2 

Assuming the non-degeneracy condition (]1.6p . we may choose real numbers v > 1 and £0 > such 
that K{q) > \q\ v for all g that satisfy \q\ < £q. Having fixed C G (^jErp |)j we see that ^> < 2. 

So, we may choose p G ( u ~^^ 1 2). 

Arguing by contradiction, we assume that #Aj > mP: there are more than mP important cubes 
within the box Bj = j — [0, m— l] d . Fix 5 > small. Consider a path 7 G Mj(n,w). Let [t 1 , ^2] be 
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the smallest interval containing all s for which 7(5) 6 Bj. Hence \t 2 — ti\ > CmP . Choose any one 
of the important cubes in Bj and let x c denote its center point. Let us define a modified path 7 as 
follows: 

(i) For s £ [0,ti] U [t 2 ,t], let 7 (s) = 7 (s). 

(ii) For s £ [h,t 2 ] let 

' l(h) + (s-h)-^^, s£[t 1 ,t 1 + m], 
x c , s £ [ti + m, t 2 — m], 

x c +{s-t 2 + m)- l{t2) ~ Xc , s£[t 2 -m,t 2 }. 



7(a) 



We have the bound 



rt2 

£(7) -£(7) > -2m-maxK(q) -2m(b- a) + K(j'(s))ds 



(4.50) 



We will prove that for sufficiently large m the right side of (|4.50p is larger than 5 > 0, contradicting 
the fact that 7 £ M<5(ra,cc>). 

Let us denote by Jo C [£i,£2] the set of times for which |7'(s)| > Sq. Therefore, we may assume 

/ K(j'(s)) ds < 2m (max K(q) + (b - a) ) + 5, (4.51) 
J Jo \\q\< 1 J 

for otherwise the right side of (I4.50P would be larger than 5. Let J\ = \pi,t 2 \ \ Jo; for these times 
s £ Ji we have |7'(s)| < eo- From (|4.50p we also obtain: 

£(7) - £(7) > -2m ^max K(q) + b - a^J + J K(<y'(r)) dr 

> — 2m I m&x.K(q) + b — a I + / ^'(r^dr 

> -2m ^maxK(g) + 6 - a^j + |Ji| • (jfj J W( r )\ dr ^j ■ ( 4 - 52 ) 

In the last line we applied Jensen's inequality. We will now prove that there exists a real number 
ei > such that 

/ \i{r)\dr > e x mP. (4.53) 
JJx 

By our assumption, the number of important cubes within Bj is more than mP . Let us now paint 
all these cubes in 2 d colors so that no two cubes share the same color. By the pigeon-hole principle 
there are at least m v 2~ d important cubes having the same color. The distance between two cubes 
of the same color is at least 1, hence we have \^/{r)\ dr > mP2~ d . Therefore, since there is C > 
such that |7'(s)| < CK"( 7 '(s)) for all s £ Jo, we have 

mP2- d < I |V(r)|dr+ / W(r)\dr 



< / \i{r)\dr + C I K{i(r))dr 

< [ \i(r)\dr + C{m + 5). (4.54) 



Ji 
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In the last step we have applied (|4.51j) . This last inequality implies (|4.53|> . since p > 1. 
Now the inequalities (|4.52p and (|4.53[) imply: 



£(7) -£(7) > -2m[maxK(q) + b-a)+\Ji 



V \ v 



?l<i / \\Ji 

-2m fmaxif (g) + b - aj + (e 1 ) u m pu ■ \Ji\ l ~ v 



> -2m ^maxK( g )+6-aj +(e l ) u m pv - [m 11 ^ " . (4.55) 



In the last inequality we have used | J\\ <n = m 1 ^ . If we have 

v + 1 



P > 



then pv + (1 — z^)/C > 1- In this case, the right side of (|4.55p is positive, and larger than S, for 
t sufficiently large. Since this contradicts the approximate optimality of 7 6 Ms, we must have 
#Aj < m P. □ 

5 Appendix 

Proof of Lemma 13. 6t The bounds in (I3.35j) follow from the fact that P is the product measure 
on Q = {a, o} z ™, with = a) = a and F(u)(j) = b) = /3. For every nonnegative integrable ip, 

(|3.35p implies 

E(V0 = J ipdF <C" J ipdFo^j = J VOjw) cflP = E(^> o <£,•). 
Similarly E(V>) > C"E(^ o 0j) for all such tj>. □ 
Proof of Theorem II. 2t Let us define 

Then Theorem 11.21 is a slight modification of the following 
Theorem 5.1 ([14J, Theorem 1.5) There is a constant C > 0, such that 



Ptfifau) ~ f(u)), ]£u)j = a 



ZioWs /or aZZ f £ L 2 (£lj). 

To derive Theorem 11.21 from this, we start with elementary observation 

C"|pi/M| < |Ai/(o;)| < C"| Pi /(w)l 
for C" = min{2a, 2/3} and C" = max{2a, 2/3}. Let k = \og{C"/C) > 0. If log > 2k, then 
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log > log ^ + log MM > i log ^ . 
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Consequently, Theorem 15.11 implies 

var(/) < C ■ y l|Aj {i%„ < 2{C"fC V hiS f f „ ■ 

On the other hand, if log jj^jj^ £ [0, 2k), then Theorem 15.11 implies 

var(/) < C ■ £ ||A,/||| < (1 + 2k)2(C") 2 C £ "^j? 



□ 
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